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(54) IMAGE ENCODING SYSTEM, IMAGE DECODING SYSTEM. INFORMATION 
STORAGE MEDIUM AND ELECTRONIC EQUIPMENT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To insert additional data 
to image data wliile reducing the degradation of 
image quality by inserting the additional data to a 
high frequency component of an orthogonal 
transformation coefficient when the orthogonal 
transformation coefficient obtained by orthogonal 
transformation is quantized. 
SOLUTION: An additional data is inserted for the 
least significant bit of the high frequency component 
of a DCT coefficient by a display part E4. Thus, 
change of image quality is not affected, for example, 
by writing of zero (the additional data) when the least 
significant bit of original image data is zero and 
writing of 1 (the additional data) when the least 

significant bit is 1. Namely, only when writing of 1 when the least significant bit of the 
original image data is zero and the writing of zero when the least significant bit is 1 , 
deviation is generated in a value of the least significant bit. The least significant bit is the 
one of the high frequency component of color difference data which is inconspicuous to 
human eyes. Therefore, possibility that the least significant bit is sensed is hardly exit even 
when the additional data is inserted into it. 
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JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim l] The image coding system characterized by including an addition data insertion 
means to insert addition data to the high frequency component of a rectangular transform 
coefficient, in the image coding system which quantizes the rectangular transform 
coefficient which divided the image into two or more blocks, performed orthogonal 
transformation to the image data of each divided block, and was obtained by orthogonal 
transformation. 

[Claim 2] The image coding system characterized by inserting said addition data to. the 
high-frequency component of the rectangular transform coefficient about color difference 
data in claim 1. 

[Claim 3] The image coding system characterized by inserting said addition data to the 
least significant bit of the high frequency component of a rectangular transform coefficient 
in claim 1 or 2. 

[Claim 4] The image coding system characterized by including a selection means to choose 

the block for insertion of addition data, in claim 1 thru/or either of 3. 

[Claim 5] The image coding system by which the specific block decided beforehand is 

characterized by being chosen as a block for insertion of addition data in claim 4. 

[Claim 6] The image coding system by which said specific block chosen is characterized by 

being blocks other than the block near the fixation point of an image in claim 5. 

[Claim 7l The image coding system characterized by including at least one side of the error 

detection data for the error detection of the marker data for discernment of addition data, 

and addition data to the addition data of the block for insertion in claim 4. 

[Claim 8] The image decr3n[)tion system carry out containing an addition data-extraction 

means extract the addition data which are the image decryption system which decrypts the 

image data encoded by the image coding system which quantizes the rectangular 

transform coefficient which divided the image into two or more blocks, performed 

orthogonal transformation to the image data of each divided block, and was obtained by 

orthogonal transformation, and were inserted in the high-frequency component of a 

rectangular transform coefficient by said image coding system as the description. 

[Claim 9] The image decryption system characterized by including a selection means to 

choose the block for an extract of addition data, in claim 8. 

[Claim 10] The image decryption system by which the specific block decided beforehand is 
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characterized by being chosen as a block for an extract of addition data in claim 9. 
[Claim 111 The image decrjrption system characterized by choosing the block for an extract 
of addition data in claim 9 based on the marker data included in addition data for 
discernment of addition data. 

[Claim 12] Divide an image into two or more blocks, and orthogonal transformation is 
performed to the image data of each divided block. The information for decrypting the 
image data encoded by the image coding system which quantizes the rectangular 
transform coefficient obtained by orthogonal transformation is included. The information 
storage medium characterized by including the information for performing processing 
which extracts the addition data by which a computer is an usable information storage 
medium and was inserted in the high frequency component of a rectangular transform 
coefBcient by said image coding system. 

[Claim 13] Electronic equipment characterized by including the means for acquiring the 
image data set as the object of coding of claim 1 thru/or one image coding system of 7, and 
said image coding system, and the means for memorizing or outputting the image data 
encoded by said image coding system. 

[Claim 14] Electronic equipment characterized by including the means for acquiring the 
image data set as the object of a decryption of claim 8 thru/or one image decryption system 
of 11, and said image decryption system, and the means for memorizing or outputting the 
image data decrypted by said image coding system. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to an image coding system, an image 

decryption system, an information storage medium, and electronic equipment. 

[0002] 

Background Art and Problem(s) to be Solved by the Invention] In recent years, electronic 
equipment, such as a digital camera convenient for creation of a homepage and a digital 
camcorder, is collecting popularity with the spread of the Internet, In these digital cameras 
and digital camcorders, the photoed image data is digitized, is compressed by picture 
compression methods, such as JPEG and MPEG, and is memorized by the information 
storage medium (record medium). And a user reads into a personal computer the image 
data memorized by the information storage medium, sticks on the text of the homepage of 
the Internet, and creates the homepage of an own original copy. 

[0003] However, unless it deals with protection etc., others will be able to copy freely the 
image data which can be perused on the Internet in this way. Therefore, the situations - 
the unapproved surreptitious use of the image data is carried out against a user's intention 
" arise. And in order to prevent unapproved surreptitious use of such image data 
effectively, to be able to add a principal's photoed personal data (name etc.) to the digitized 
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image data is desired. 

[0004] By the way, the user field which can store user data is defined in the data format of 
JPEG and MPEG. Therefore, it is also possible to aim at prevention of unapproved 
surreptitious use of image data by storing the above-mentioned personal data in this user 
field. 

[0005] However, if the hardware which performs an image decrsnption, and software have 
the composition that neither existence of the user field nor the content can be recognized 
even if it stores personal data in the user field, the personal data stored with much trouble 
will be lost. 

[0006] Moreover, also when a user wants to mal&e it secrecy, in having stored personal data 
in the user field, existence of personal data and the content will be easily loiown by others. 
[0007] Moreover, as for degradation of the image quality by adding personal data (a wide 
sense addition data) to image data, stopping to the minimum is desirable. 
[0008] In addition, the conventional technique which inserts electronic data, such as 
electronic key data, into the icon which is a kind of image data so that human being cannot 
perceive is indicated by JP,10-107788,A. However, with this conventional technique, 
electronic data is inserted into image data by using grant of the attribute of the 
transparent plane color to image data, and the exclusive OR of a subject-copy image and 
the electronic data which should be inserted. Therefore, this conventional technique does 
not insert electronic data using the property of DCT (a wide sense orthogonal 
transformation) used by JPEG, MPEG, etc. 

[0009] This invention is made in view of the above technical technical problems, and the 
place made into the object is to offer the image coding system which enables insertion of 
the addition data to image data, an image decryption system, an information storage 
medium, and electronic equipment, suppressing degradation of image quality low. 
[0010] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, 
this invention divides an image into two or more blocks, performs orthogonal 
transformation to the image data of each divided block, and is characterized by including 
an addition data insertion means to insert addition data to the high firequency component 
of a rectangular transform coefficient in the image coding system which quantizes the 
rectangular transform coefficient obtained by orthogonal transformation. 
[00 11] According to this invention, orthogonal transformation (for example, DCT, a 
Hadamard transform, etc.) is performed to each block acquired by dividing an image, and 
an image is encoded by the obtained rectangular transform coefficient being quantized. 
And according to this invention, addition data (data for removing a name, a password, 
electronic key data, control data, restricted data, and an image effect etc.) are inserted to 
the high fi-equency component (rectangular transform coefficient of a high firequency term) 
of a rectangular transform coefficient (rectangular transform coefficient after 
quantization) in the case of this coding (overwrite). Here, there is a property to be hard 
coming to catch the signal of a high firequency component in human being's eyes. Therefore, 
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according to this invention, various addition data can be inserted in image data, 
suppressing degradation of image quality low without almost being perceived by human 
being's eyes. 

[0012] In addition, hardware may realize and software may reahze the addition data 
insertion means of this invention. Or the combination of hardware and software may 
reahze. 

[0013] Moreover, this invention is characterized by inserting said addition data to the 
high-frequency component of the rectangular transform coefficient about color difference 
data. If it does in this way, skillful ****** of the property of the eyes of human being that a 
reaction to the extent that change of brightness is received is not shown to change of the 
color difference is carried out, and addition data can be inserted, suppressing degradation 
of image quality low. 

[0014] Moreover, this invention is characterized by inserting said addition data to the least 
significant bit of the high frequency component of a rectangular transform coefficient. If it 
does in this way, the value of the least significant bit just needs to come to shift from a 
value original by the probabihty of 1/about 2, and it will become possible to suppress 
degradation of image quality to the minimum. 

[0015] Moreover, this invention is characterized by including a selection means to choose 
the block for insertion of addition data. If it does in this way, it enables it to insert addition 
data, or can enable it to insert addition data to the block of arbitration only to a specific 
block. 

[0016] Moreover, it is characterized by choosing the specific block with which this 
invention was decided beforehand as a block for insertion of addition data. If it does in this 
way, the block for insertion of addition data can be chosen by simple processing. 
[0017] Moreover, it is characterized by said specific blocks with which this invention is 
chosen being blocks other than the block near the fixation point of an image. If it does in 
this way, it cannot be more conspicuous and image quality change resulting from insertion 
of addition data can be carried out. 

[0018] Moreover, this invention is characterized by including at least one side of the error 
detection data for the error detection of the marker data for discernment of addition data, 
and addition data to the addition data of the block for insertion. Thus, based on this 
marker data, the block for insertion can be chosen now proper by including marker data to 
addition data in the case of an image decryption. Moreover, it becomes possible to raise the 
dependability of the addition data inserted by including error detection data to addition 
data. 

[0019] Moreover, this invention is the image decryption system which decrypts the image 
data encoded by the image coding system which quantizes the rectangular transform 
coefficient which divided the image into two or more blocks, performed orthogonal 
transformation to the image data of each divided block, and was obtained by orthogonal 
transformation, and it carries out containing an addition data-extraction means extract 
the addition data inserted in the high-frequency component of a rectangular transform 
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coefficient by said image coding system as the description. 

[0020] According to this invention, the image decryption system which can extract the 
addition data inserted to the high frequency component of a rectangular transform 
coefficient by the image coding system proper is realizable. 

[0021] In addition, as for addition data, it is desirable to be extracted from the high 
frequency component of the rectangular transform coefficient about color difference data, 
and it is still more desirable to be extracted from the least significant bit of the high 
frequency component of a rectangular transform coefficient. 

[0022] Moreover, hardware may reahze and software may reahze the addition data 
extraction means of this invention. Or the combination of hardware and software may 
reahze. 

[0023] Moreover, this invention is characterized by including a selection means to choose 
the block for an extract of addition data. If it does in this way, it will become possible to 
extract the addition data inserted in the specffic block, or to extract the addition data 
inserted in the block of arbitration. 

[0024] Moreover, it is characterized by choosing the specific block with which this 
invention was decided beforehand as a block for an extract of addition data. If it does in 
this way, the block for an extract of addition data can be chosen by simple processing. 
[0025] Moreover, this invention is characterized by choosing the block for an extract of 
addition data based on the marker data included in addition data for discernment of 
addition data. Thus, if marker data are used, the block which should extract addition data 
can be chosen proper at the time of an image decryption. 

[0026] Moreover, this invention divides an image into two or more blocks, and orthogonal 
transformation is performed to the image data of each divided block. The information for 
decr3^ting the image data encoded by the image coding system which quantizes the 
rectangular transform coefficient obtained by orthogonal transformation is included. It is 
characterized by including the information for performing processing which extracts the 
addition data by which a computer is an usable information storage medium and was 
inserted in the high frequency component of a rectangular transform coefficient by said 
image coding system. If such an information storage medium is used, a software means can 
reahze an image decryption system. 

[0027] Moreover, the electronic equipment concerning this invention is characterized by 
including the means for acquiring the image data set as the object of coding of one of the 
above-mentioned image coding systems, and said image coding system, and the means for 
memorizing or outputting the image data encoded by said image coding system. Moreover, 
the electronic equipment concerning this invention is characterized by including the means 
for acquiring the image data set as the object of a decryption of one of the above-mentioned 
image decryption systems, and said image decryption system, and the means for 
memorizing or outputting the image data decrypted by said image coding system. 
[0028] Thus, according to the electronic equipment using the image coding system and 
image decryption system of this invention, various addition data are inserted to the 
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acquired image data, and it can encode now. Moreover, in case the encoded image data is 
decrypted, the inserted addition data can be extracted proper. Thereby, prevention of 
unapproved surreptitious use of the image data by others etc. can be aimed at now. 
[0029] 

[Embodiment of the Invention] Hereafter, the suitable operation gestalt of this invention is 
explained to a detail using a drawing. 

[0030] 1. The example of the block diagram of the image coding system of this operation 
gestalt and an image decryption system is shown in a block diagram 1 and drawing 2 . 
[0031] In addition, below taking the case of image coding in JPEG, and an image 
decryption, it explains. 

[0032] Moreover, in the image coding system of this invention, and an image decryption 
system, it can also consider as the configuration which omits the part about the block of 
those other than drawing 1 , addition data insertion section [ of drawing 2 </A> ] 20. and 
addition data extraction section 40 . 

[0033] Moreover, hardware, such as a circuit, may realize and the software which operates 
on a microcomputer may reaUze each block of drawing 1 and drawing 2 . Or the 
combination of HADOWE and software may reahze. 

[0034] The data (the image data created with CG tool etc. is sufficient) of the image 
(subject-copy image) photoed by CCD etc. are stored in a fi^ame memory etc. Here, the 
photoed image is divided into two or more blocks B1-B47 (the block count is arbitration) as 
shown in El of drawing 3 . And it is DCT (discrete cosine transform.) by the DCT section 10 
of drawing 1 to each divided block. Orthogonal transformation including a Hadamard 
transform, characteristic value conversion, etc. is performed to a wide sense. Thereby, 
frequency (spatial frequency) decomposition of the image is carried out. And each DCT 
multiplier (a wide sense rectangular transform coefficient) obtained by DCT is quantized 
with a quantizer 12 (a division is done with a quantization table value). In addition, the 
quantization table value used with a quantizer 12 is stored in the quantization table 14. 
[0035] And in the image coding system of this operation gestalt, the addition data insertion 
section 20 inserts addition data to the high frequency component (E3 reference of drawing 
3 ) of the DCT multipUer after quantization. Here, various things, such as data for 
removing personal data (a name, a password, electronic signature), the data in which a 
copyright is shown, electronic key data (a cryptographic key, a pubHc key, private key data), 
the control data (marker data, CRC data) about addition data, restricted data, and an 
image effect (mosaic) as addition data inserted, can be considered. 

[0036] Huffman coding for a data compression (entropy code modulation, variable length 
coding) is performed by the Huffman coding machine 22 after insertion of addition data, 
and, thereby, compression image data is obtained. This compression image data is 
memorized by for example, the information storage medium (record medium), or is 
outputted outside through a communication line. In addition, the HufEman table value 
used with the Huffman coding vessel 22 is stored in the Huffixian table 24. 
[0037] On the other hand, in the image decryption system of drawing 2 , the Hufifinan 
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decryption machine 30 performs the HufEman decryption (an entropy decryption, 
variable-length decryption) to compression image data first using the HufiBman table value 
from the Huffinan table 32. 

[0038] And the addition data extraction section 40 extracts addition data from the image 
data after the HufGcaan decryption. That is, the addition data extraction section 40 extracts 
the addition data inserted in the high firequency component of a DCT multiplier by the 
image coding system of drawing 1 . 

[0039] Next, the reverse quantizer 42 performs reverse quantization using the 
quantization table value from the quantization table 44, and the reverse DCT section 46 
performs Reverse DCT. Thereby, image data (false image data) is decoded. In addition, the 
quantization table value stored in the Huf&nan table value stored in the HufEman table 32 
or the quantization table 44 will be taken out from compression image data. 
[0040] according to this operation gestalt, addition data are inserted to the high-firequency 
component (E3 reference of drawing 3 ) (or the DCT multiplier of a high-frequency term 
receiving) of a DCT multiplier. Therefore, while being able to insert various addition data 
in image data, without being perceived by human being's eyes, degradation of the image 
quahty resulting &om insertion of addition data can be suppressed low. namely, — like the 
signal of a firequency component high to human being's eyes - catching ••**-- it is because 
it is thought that possibility that the efiEect will be perceived by human being's eyes is very 
low, and degradation of image quality is hardly noticed, either, even if there is flume 
****** and it inserts addition data in the high firequency component of a DCT multiplier 
like this operation gestalt. 

[0041] Moreover, by the technique of storing addition data in the user field, when the 
image decryption system has become the configuration that neither existence of the user 
field nor the content can be recognized, the problem that the addition data stored with 
much trouble will be lost arises. On the other hand, addition data will be stored in the field 
where image data should be stored essentially with this operation gestalt. Therefore, 
addition data are not lost even if the image decr5T)tion system has the composition that 
neither existence of the user field nor the content can be recognized. 

[0042] Moreover, by the technique of storing addition data in the user field, there is a 
problem that the existence of addition data and the content which a user wants to make 
into secrecy will be easily known by others. On the other hand, with this operation gestalt, 
addition data are inserted to image data. Therefore, the situation where existence of 
addition data and the content will be known by others can be prevented, and the 
confidentiality of addition data can be raised. 

[0043] Now, with this operation gestalt, as shown in El and E2 of drawing 3 , an image is 
divided into the block of 8 pixel x8 pixel. And there are a block of Y (brightness) data, a 
block of Cr (color difference of red and brightness) data, and a block of Cb (color difference 
of blue and brightness) data as this block of 8 pixel x8 pixel divided. 

[0044] And with this operation gestalt, as shown in E3 of drawing 3 , addition data are 
inserted to the high fi*equency component of the DCT multipher of a block (one [ at least ] 
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block of Cr and Cb data) of color difference data. 

[0045] That is, to change of brightness, although it is sensitive, there is a property in which 
a reaction to the extent that change of brightness is received is not shown to change of the 
color difference in human being's eyes. Therefore, degradation of the image quality 
resulting from insertion of addition data can be suppressed still fewer by inserting addition 
data not to the block of brightness data but to the block of color difference data. 
[0046] Furthermore, with this operation gestalt, as shown in E4 of drawing 3 , addition 
data are inserted to the least significant bit of the high frequency component of a DCT 
multiplier (it has overwritten). If it does in this way, about the writing of 1 (addition data) 
in case the writing of 0 (addition data) in case the least significant bit of the original image 
data is 0, for example, and the least significant bit are 1, change of image quality will not 
be affected at all. That is, only when it is the writing of 0 in case the writing of 1 in case the 
least significant bit of the original image data is 0, and the least significant bit are 1, 
deflection will arise in the value of the least significant bit. Therefore, the value of the least 
significant bit just needs to come to shift fi:om a value original by the probability of 1/about 
2. 

[0047] And this least significant bit is the least significant bit of the high frequency 
component of the color difference data which are not conspicuous to human being's eyes. 
Therefore, according to this operation gestalt, even if it inserts addition data, there is 
almost no possibility that the effect by insertion of addition data will be perceived by 
human being's eyes, and degradation of image quality can be suppressed to the minimum. 
[0048] In addition, if degradation of image quality is disregarded to some extent, you may 
make it insert addition data in the block of brightness data in E3 of drawing 3 , although 
addition data are inserted in the block of color difference data. Or when adopting not a 
color difference system (Y, Cr, Cb) but a primary color system (R, G, B), you may make it 
insert addition data in all the blocks of R, G, and B data, and may make it insert addition 
data in any one of the blocks of R, G, and B data (two [ or ]). For example, you may make it 
insert addition data in the block of B data in an image with many color components of red 
(R) and green (G). 

[0049] Moreover, although addition data are inserted in the highest fi:equency component 
in E3 of drawing 3 , you may make it insert addition data not only in the highest firequency 
component but in the 2nd, the 3rd, the 4th, etc. at a high firequency component. Moreover, 
although addition data are inserted in the least significant bit, you may make it insert 
addition data in the bit of not only the least significant bit but one high order, the bit of 2 
high orders, etc. in E4 of drawing 3 . 

[0050] Now, he establishes the means for choosing the block for insertion of addition data 
as an image coding system, and is trying to establish the means for choosing the block for 
an extract of addition data as an image decryption system with this operation gestalt. 
[0051] For example, in drawing 4 , Bl and B4 firom which the block number table 50 for 
insertion is set as the insertion object of addition data, and the block number (number of 
the specific block decided beforehand) of B7, B16, B31, B40, B43, and B46 are memorized. 
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And the block count counter 51 performs count actuation based on the block number from 
the block number table 50 for insertion, and outputs selection directions to the block 
selection section 52 for insertion to the timing by which the block for insertion is scanned. 
Thereby, the specific block Bl decided beforehand, B4, and B7, B16, B31, B40, B43 and 
B46 come to be chosen as a block for insertion of addition data. 

[0052] Moreover, in drawing 4 , Bl and B4 from which the block number table 54 for an 
extract is set as the extract object of addition data, and the block number of B7, B16, B31, 
B40, B43, and B46 are memorized. And the block count counter 55 outputs selection 
directions to the block selection section 56 for an extract to the timing by which the block 
for an extract is scanned. Thereby, the specific block Bl decided beforehand, B4, and B7, 
B16, B31, B40, B43 and B46 come to be chosen as a block for an extract of addition data. 
[0053] Thus, if the technique of choosing the same specific block by the image coding 
system and the image decryption system is adopted, the addition data inserted at the time 
of coding can be certainly extracted at the time of a decryption. And only based on a block 
number, there is an advantage that insertion and an extract of addition data are realizable 
for a block count counter by simple processing in which count actuation is carried out in 
this technique. 

[0054] In addition, as shown in drawing 4 , as for the specific selected block, it is desirable 
that they are blocks (circumference block) other than the block near the fixation point of an 
image (for example, B19, B20, B27, B28). It is because the image quality change resulting 
from insertion of addition data comes to be more noticeable when the block near a fixation 
point turns into a block for insertion of addition data. On the other hand, human being's 
eyes have the property to gaze at near a fixation point. Therefore, if blocks other than the 
block near a fixation point are carried out to the block for insertion of addition data, the 
situation where the image quality change resulting from insertion of addition data will be 
noticed by the user can be prevented effectively. 

[0055] You may make it choose insertion and the block for an extract by the following 
technique. 

[0056] That is, in drawing 5 , the image coding system (addition data insertion section) is 
including marker data (data for discernment of addition data), a data length, the body of 
data, and CRC data (error detection data of addition data) in addition data. In addition, 
marker data are a constant here and a data length and CRC data are calculated based on 
the body of data. And it inserts at a time in the least significant bit of the high frequency 
component of the DCT multiplier of each block 1 bit of addition data which contain marker 
data etc. in this way. 

[0057] On the other hand, an image decryption system (addition data extraction section) 
scans the data of the least significant bit of the high frequency component of the DCT 
multiplier of all blocks. And it is judged that addition data are inserted in the place where 
the characteristic pattern (pattern of marker data) appeared. That is, marker data are 
operated as search data of addition data. And when addition data were inserted and it is 
judged based on marker data, it extracts the data length following marker data, the body of 
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data, and 1 bit of CRC data at a time from the least significant bit of the high frequency 
component of the DCT multiplier of each block. Moreover, whether an error is in the 
extracted addition data based on CRC data checks. 

[0058] The agreement which determines the block for selection beforehand by the image 
coding system and the image decr3rption system was required of the technique of drawing 
4 . On the other hand, by the technique of drawing 5 , such an agreement becomes 
unnecessary. Therefore, an image coding system can insert addition data now in the block 
of arbitration. 

[0059] Moreover, by the technique of drawing 4 , when logging of an image is performed, 
the problem that all or some of addition data will be lost arises (for example, when only the 
image of blocks B8-B39 is cut down). On the other hand, by the technique of drawing 5 R> 
5, loss of the addition data based on logging of an image can be effectively prevented now 
by distributing and inserting addition data in two or more blocks (for example, all blocks). 
For example, addition data are distributed and inserted in blocks B0-B7. Similarly, the 
same addition data are distributed and inserted in each of blocks B8-B15, B16-B23, 
B24-B31, B32-B39, and B40-B47. Also when doing in this way, for example only the image 
of blocks B8-B39 is cut down, addition data (B8-B15, B16-B23, B24-B31, addition data 
distributed and inserted in each of B32-B39) will remain, and loss of addition data is 
prevented. 

[0060] 2. The example of the detailed block diagram of the addition data insertion section 
20 is shown in example drawing 6 of a detail of the addition data insertion section and the 
addition data extraction section. 

[0061] The bit-select section 60 for insertion is for choosing the bit for insertion, and data 
other than the bit for insertion carry out through [ of the bit- select section 60 for insertion ] 
as it is, and are outputted to the Huffinan coding machine 22. The bit for insertion is the 
least significant bit of the high frequency component of the DCT multiplier in the block for 

insertion here (E4 reference of drawing 3 ). 

[0062] That is, directions of selection will be outputted, if the block count counter 62 which 
the bit-select section 60 for insertion contains counts the block count in the case of the scan 
of a block and its block currently scanned corresponds with the block for insertion (refer to 
drawing 4 ). Moreover, if the number (arity) counter 63 of components counts the number 
of components in the case of the scan of a frequency component (frequency term) and its 
frequency component currently scanned corresponds with the frequency component for 
insertion (namely, high-frequency component of drawing 3 ), it will output directions of 
selection. And the least significant bit of the high frequency component of the DCT 
multiplier in the block for insertion comes to be chosen by choosing the least significant bit 
of the frequency component for insertion. 

[0063] The insertion data which should be inserted in the bit for insertion are outputted 
from a shift register 64. That is, if, as for the bit-select section 60 for insertion, the bit for 
insertion is chosen, shift directions will be outputted to the State machine 76, and the 
carrier beam State machine 76 will output shift directions for this to a shift register 64. 
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Then, a shift register 64 performs a shift action and outputs l"bit insertion data to the 
bit-select section 60 for insertion. And insertion data are inserted to the bit for insertion as 
which the bit-select section 60 for carrier beam insertion was chosen in this 1-bit insertion 
data. 

[0064] The output of MUX (multiplexer)66 is connected to the input of a shift register 64, 
and the output of the marker constant register 68, the data length register 70, a data 
register 72, and the CRC register 74 is connected to the input of MUX66. 
[0065] Here, the marker constant register 68, the data length register 70, a data register 
72, and the CRC register 74 store marker data (constant data), a data length, the body of 
data, and CRC data respectively (refer to drawing 5 ). 

[0066] Here, based on the body of data from a data register 72, and the count directions 
from the State machine 76, the data length count section 71 calculates the data length 
stored in the data length register 70. Moreover, based on the body of data from a data 
register 72, and the count directions from the State machine 76, the CRC count section 75 
calculates the CRC data stored in the CRC register 74. Moreover, the writing of the body of 
data to a data register 72 is performed by the external device (for example, microcomputer). 
[0067] Based on the selection directions from the State machine 76, MUX66 chooses either 
of the outputs of the marker constant register 68, the data length register 70, a data 
register 72, and the CRC register 74, and outputs it to a shift register 64. Thereby, 
sequential storing of the insertion data which should be inserted in the bit for insertion 
comes to be carried out per several bits (for example, 8 bitwises) at a shift register 64. That 
is, the marker data from the marker constant register 68 are first stored in a shift register 
64, then the data length from the data length register 70 is stored, then the body of data 
from a data register 72 is stored, and then the CRC data from the CRC register 74 come to 
be stored. A shift register 64 wiU carry out the sequential shift of every 1 bit of each of 
these stored data, and will output them to the bit-select section 60 for insertion as 
insertion data. 

[0068] The example of the detailed block diagram of the addition data extraction section 40 
is shown in drawing 7 . 

[0069] The bit" select section 80 for an extract is for choosing the bit for an extract. The bit 
for an extract is the least significant bit of the high frequency component of the DCT 
multiplier in the block for an extract here. In addition, since the function and actuation of 
the block count counter 82 and the number counter 83 of components which the bit-select 
section 80 for an extract includes are almost the same as that of the block count counter 62 
of drawing 6 , and the number counter 63 of components, explanation is omitted here. 
[0070] The sequential input of the 1-bit extract data from the bit for an extract chosen by 
the bit-select section 80 for an extract is carried out at a shift register 84. That is, if, as for 
the bit-select section 80 for an extract, the bit for an extract is chosen, shift directions will 
be outputted to the State machine 96, and the carrier beam State machine 96 will output 
shift directions for this to a shift register 84. Thereby, a shift register 84 performs a shift 
action and the sequential input of the 1-bit extract data comes to be carried out from the 
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bit-select section 80 for an extract at a shift register 84. 

[00711 The output of a shift register 84 is inputted into the comparator 86 for markers, the 
data length register 90, a data register 92, and the CRC count section 95. 
[0072] The comparator 86 for markers compares the 8-bit extract data and the marker data 
of the constant from the marker constant register 88 which are stored in a shift register 84. 
And when not in agreement, the State machine 96 outputs shift directions to a shift 
register 84, and a shift register 84 performs a shift action. And the comparator 86 for 
markers compares again the 8-bit extract data after the shift action from a shift register 84 
with the marker data from the marker constant register 88. 

[0073] Thus, if the comparator 86 for markers performs sequential comparison actuation 
and extract data and its marker data correspond, it will output a coincidence signal to the 
State machine 96, And after, as for the carrier beam State machine 96, only the given 
number of bits outputs shift directions for this coincidence signal to a shift register 84 
based on the shift directions from the bit-select section 80 for an extract, latch directions 
are outputted to the data length register 90. Thereby, the datia length in extract data 
comes to be stored in the data length register 90. 

[0074] Next, after, as for the carrier beam State machine 96, only the given number of bits 
outputs shift directions for the data length from the data length register 90 to a shift 
register 84 based on the shift directions from the bit-select section 80 for an extract, latch 
directions are outputted to a data register 92. Thereby, the body of data in extract data 
comes to be stored in a data register 92. 

[0075] The CRC count section 95 calculates CRC based on the body of data stored in a data 
register 92, and the CRC data in extract data, and outputs the result to the State machine 
96. The State machine 96 is based on this CRC result, and sets or resets an error flag. And 
reading appearance of the body of data stored in a data register 92 and the error flag from 
the State machine 96 will be carried out by the external device (for example, 
microcomputer). 

[0076] 3. Explain the example of the electronic equipment using electronic equipment next 
the image coding system explained to the above, or an image decryption system. 
[0077] For example, the example of the block diagram of the digital camera which is one of 
the electronic equipment is shown in drawing 8 (A), and the external view is shown in it at 
drawing 9 (A). This digital camera includes a microcomputer 500, a control unit 502 
(shutter 503 of drawing 9 (A)), a lens 504, CCD506, A/D converter 508, the image encoder 
(a wide sense image coding system) 510, memory 512, the image output section 514 
(LCD515), the information storage interface 516 (the lead of a flash memory 517, light 
equipment), and the communication link interface 518. 

[0078] The image data set as the object of coding of the image encoder 510 is acquired by a 
lens 504 and CCD506. Moreover, an image output is carried out by the image output 
section 514, or the image data (compression image data) encoded with said image encoder 
510 communicates [ **** / that information storage media (a flash memory, IC card, etc.) 
memorize ] to external devices, such as a personal computer, through the communication 
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link interface 518 through the information storage medium interface 516. 
[0079] The example of the block diagram of the printer which is one of the electronic 
equipment is shown in drawing 8 (B), and the external view is shown in it at drawing 9 (B). 
This printer includes a microcomputer 520, a control unit 522 (manual operation button 
523 of drawing 9 (B)), the image decryption machine (a wide sense image decr3Tption 
system) 524, memory 526 (bit map memory etc.), the image output section 528 (LCD529), 
the printed output section 530, and the communication link interface 532. 
[0080] The image data (compression image data) set as the object of a decrjrption of the 
image decryption machine 524 is acquired by the communication hnk through the 
communication link interface 532 with external devices, such as a personal computer and a 
digital camera. Moreover, the image data (false image data) decrypted with the image 
decrj^tion vessel 524 is printed by print paper by the printed output section 530, and is 
outputted. 

[0081] The example of the block diagram of the personal computer of the pocket mold 
which is one of the electronic equipment is shown in drawing 8 (C), and the external view is 
shown in it at drawing 9 (C). This personal computer includes a microcomputer 540, a 
control unit 542 (keyboard 543 of drawing 9 (O), the information storage interface 544 (the 
lead of DVD545, light equipment), memory 546, the image output section 548 (LCD549), 
the sound output section 550 (loudspeaker 551), and the communication link interface 552. 
[0082] In drawing 8 (C), the image decryption section (a wide sense image decryption 
system) 541 processes a decryption of image data (compression image data). The function 
of this image decryption section 541 is realized by hardware, such as a microcomputer 540, 
and software, such as an image decryption program stored in DVD545 which is an 
information storage medium. The image data set as the object of a decryption of the image 
decryption section 541 is acquired by reading from an information storage medium or 
communicating through the communication link interface 552 through the information 
storage medium interface 544, etc. Moreover, the image output of the image data (false 
image data) decr3rpted by the image decryption section 541 is carried out by the image 
output section 548. 

[0083] According to the electronic equipment using the image coding system and image 
decryption system of this operation gestalt, addition data, such as personal data, are 
inserted to the image data obtained by photography or the image data created with CG tool, 
and it can encode now. And in case the encoded image data is decrypted, the inserted 
addition data can be extracted proper. Thereby, the image data obtained by photography or 
CG tool can prevent now to others the situation by which unapproved surreptitious use is 
carried out. Moreover, it also becomes possible to remove the image effect given to the 
image using the extracted addition data. Furthermore, the situation where existence of 
addition data and the content will be known by others can also be prevented effectively. 
[0084] In addition, as electronic equipment which can use the image coding system and 
image decryption system of this operation gestalt, various electronic equipment, such as a 
digital camcorder, a pocket mold information processor, game equipment, car navigation 
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equipment, a projector, a POS terminal, an electronic notebook, television, a word 
processor, equipment equipped with the touch panel, a hard disk drive unit, optical disk 
(CD, DVD) equipment, and magneto'optic'disk (MO) equipment, can be considered besides 
what is shown in drawing 8 R> 8 (A) * drawing 9 (C). 

[0085] In addition, this invention is not limited to this operation gestalt, but deformation 
implementation various by within the limits of the summary of this invention is possible 
for it. 

[0086] For example, in invention which relates to a subordination claim among this 
inventions, it can also consider as the configuration which omits a part of requirements for 
a configuration of the claim of a subordination place. Moreover, the important section of 
invention concerning the independent claim of 1 of this invention can also be subordinated 
to other independent claims. 

[0087] Moreover, although this operation gestalt explained the example of application in 
JPEG, this invention is applicable to MPEG, H.261, etc. For example, what is necessary is 
just to apply this invention to I picture (Intra-Picture) in MPEG. Moreover, the various 
block division according to 4-2^0, 4:2*2 coding methods, etc. is possible also for block 
division of an image. 

[0088] In addition, in JPEG, not only the irreversible coding method using DOT but the 
reversible coding method which does not use DCT is defined. Therefore, in applying this 
invention to JPEG, based on the marker of SOF (start OBU firame), it judges an 
irreversible coding method or a reversible coding method first. And when image data is 
encoded by the reversible coding method, it is desirable to make it not decrypt. 
[0089] Moreover, as addition data inserted and extracted by this invention, it is not limited 
to what was explained with this operation gestalt, but various things can be considered. 
[0090] Moreover, the configuration of the image coding system of this invention, an image 
decryption system, and electronic equipment is not limited to what was shown by drawing 
1 , drawing 2 , drawing 6 • drawing 9 (C), either, but various deformation implementation 
is possible for it. 

[0091] Moreover, although the selection technique of an object block also has especially the 
desirable technique explained by drawing 4 and drawing 5 R> 5, it is not limited to this, 
either but various deformation implementation is possible for it. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] It is the example of the block diagram of the image coding system of this 
operation gestalt. 

[Drawing 2] It is the example of the block diagram of the image decryption system of this 
operation gestalt. 

[Drawing 3l It is drawing for explaining the technique of inserting addition data in the 
least significant bit of the high fi-equency component of a DCT multiplier. 
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[Drawing 4] It is drawing for explaining the technique of choosing the specific block 
decided beforehand as the block for insertion of addition data, and a block for an extract. 
^Drawing 5] It is drawing for explaining the technique of including marker data, CRC data, 
etc. in addition data. 

[Drawing 6] It is the example of the detailed block diagram of the addition data insertion 
section. 

[Drawing 7] It is the example of the detailed block diagram of the addition data extraction 
section. 

[Drawing 8] Drawing 8 (A), (B), and (C) are the examples of the block diagram of the 
various electronic equipment using the image coding system of this operation gestalt, and 
an image decryption system. 

[Drawing 9] Drawing 9 (A), (B), and (C) are the examples of the external view of the 

various electronic equipment using the image coding system of this operation gestalt, and 

an image decr3rption system. 

[Description of Notations] 

10 The DCT Section 

12 Quantizer 

14 Quantization Table 

20 Additions Data Insertion Section 

22 Huffman Coding Machine 

24 Huffman Table 

30 Huffman Decryption Machine 

32 Huffman Table 

40 Addition Data Extraction Section 

42 Reverse Quantizer 

44 Quantization Table 

46 The Reverse DCT Section 

50 Block Number Table for Insertion 

51 Block Count Counter 

52 Block Selection Section for Insertion 

54 Block Number Table for Extract 

55 Block Count Counter 

56 Block Selection Section for Extract 
60 Bit-Select Section for Insertion 

62 Block Count Counter 

63 The Number Counter of Components 

64 Shift Register 
66 MUX 

68 Marker Constant Register 

70 Data Length Register 

71 Data Length Count Section 



15/16 



Japanese Publication nunnber : 2000-312296 A 

72 Data Register 

74 CRC Register 

75 CRC Count Section 

76 State Machine 

80 Bit-Select Section for Extract 

82 Block Count Counter 

83 The Number Counter of Components 

84 Shift Register 

86 Comparator for Markers 
88 Marker Constant Register 
90 Data Length Register 
92 Data Register 

95 CRC Count Section 

96 State Machine 
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